Papers with real-life applications
SimUSER: Simulating User Behavior with Large Language Models for Recommender System Evaluation (2025.acl-industry)
Copied to clipboard
| Challenge: | Recommender systems are a key component of our day-to-day lives, but evaluation remains a challenge due to the gap between offline metrics and online behaviors. |
| Approach: | They propose a framework that enables users to build believable human proxies from historical data. |
| Outcome: | The proposed framework exhibits closer alignment with real humans than previous work, both at micro and macro levels. |
Preemptive Detection and Correction of Misaligned Actions in LLM Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have revolutionized human-AI collaboration by enabling autonomous agents to execute complex, multi-step tasks. |
| Approach: | They propose a method that leverages the belief reasoning ability of LLMs to detect misaligned actions. |
| Outcome: | Experiments on three widely used tasks show that InferAct outperforms other methods on Marco-F1 and emnlp2025. |
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots (2022.findings-acl)
Copied to clipboard
| Challenge: | Sub-Slot based task-oriented dialogs provide slot values segment by segment over multiple turns. |
| Approach: | They define a task called Sub-Slot based Task-Oriented Dialog (SSTOD) they build a Chinese dialog dataset SSD for boosting research on SSTOD. |
| Outcome: | The proposed task is called Sub-Slot based Task-Oriented Dialog (SSTOD) it includes 40K dialogs and 500K utterances from Chinese names, phone numbers, ID numbers and license plate numbers . the dataset is well annotated with sub-slot values, slot values, dialog states and actions . |
RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World Scenarios (2025.acl-long)
Copied to clipboard
| Challenge: | RuleArena assesses the ability of large language models (LLMs) to follow complex, real-world rules in reasoning. |
| Approach: | They propose a benchmark to evaluate the ability of large language models (LLMs) to follow complex, real-world rules in reasoning. |
| Outcome: | The proposed benchmark covers airline baggage fees, NBA transactions, and tax regulations. |
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions (2024.naacl-long)
Copied to clipboard
| Challenge: | In order to perform downstream tasks, Large Language Models (LLMs) need continual adaptation without catastrophic forgetting. |
| Approach: | They propose a new paradigm that allows for continual adaptation without catastrophic forgetting . they propose to replay previous data based on task similarity with instructions . |
| Outcome: | The proposed method improves performance over 16 tasks with different training orders. |
Developing Prefix-Tuning Models for Hierarchical Text Classification (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a key task in many industrial applications. Pre-trained Language Models (PLMs) have become dominant for most natural language processing (NLP) tasks. |
| Approach: | They investigate how prefix tuning can improve hierarchical text classification . prefix-tuning model only needs less than 1% of parameters to achieve performance . |
| Outcome: | The proposed model can achieve comparable performance to regular full fine-tuning. |
Weighted Contrastive Learning With False Negative Control to Help Long-tailed Product Classification (2023.acl-industry)
Copied to clipboard
| Challenge: | Item categorization (IC) aims to classify a product into leaf nodes in a categorical taxonomy due to scarce supervision. |
| Approach: | They propose to use K-positive contrastive loss (KCL) to address IC task’s long-tail issue by re-weighting positive pairs in the KCL loss with a regularization that the sum of weights should be constrained to K+1 as close as possible. |
| Outcome: | The proposed method improves on the long-tail issue in the image classification task and when using text-based contrastive learning, it can be applied on the IC task. |
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing pre-trained models suffer from slow inference speed due to cross-modal attention in transformer architecture. |
| Approach: | They propose a multimodal approach that accelerates the inference time of ITR by thousands of times . they extract pre-cached feature indexes offline and employ instant dot-product matching online . |
| Outcome: | The proposed approach outperforms existing models that consume 1000 times magnitude of computational hours using the same features. |
Explainable Clinical Decision Support from Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Clinical prediction models often use structured variables and provide outcomes that are not readily interpretable by clinicians. |
| Approach: | They propose a hierarchical CNN-transformer model with explicit attention as an interpretable, multi-task clinical language model. |
| Outcome: | The proposed model achieves AUROCs of 0.75 and 0.78 on sepsis and mortality prediction. |
DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to answer questions over Knowledge Graphs (KGQA) are not available for KGQA. |
| Approach: | They propose a framework to improve the neural-symbolic reasoning capabilities of language agents powered by Large Language Models (LLMs) they show that DARA can be efficiently trained with a small number of high-quality reasoning trajectories. |
| Outcome: | The proposed framework outperforms in-context learning-based agents with GPT-4 and alternative fine-tuned agents across different benchmarks. |
Learning from Executions for Semantic Parsing (2021.naacl-main)
Copied to clipboard
| Challenge: | Semantic parsing aims at translating natural language (NL) utterances onto machine-interpretable programs. |
| Approach: | They propose to encourage a parser to generate executable programs for unlabeled NL utterances. |
| Outcome: | The proposed training objectives outperform conventional methods on Overnight and GeoQuery. |
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural approaches for natural language generation are typically developed offline for specific domains. |
| Approach: | They propose a method to expand NLG knowledge incrementally to new domains . major challenge is catastrophic forgetting, meaning a model forgets the knowledge it has learned before . |
| Outcome: | The proposed method outperforms other methods by effectively mitigating catastrophic forgetting issue. |
EntSUMv2: Dataset, Models and Evaluation for More Abstractive Entity-Centric Summarization (2023.emnlp-main)
Copied to clipboard
| Challenge: | Entity-centric summarization is a form of controllable summarizing that aims to generate a summary for a specific entity given a document. |
| Approach: | They propose to use a more abstract version of the original entity-centric ENTSUM summarization dataset to generate a shorter annotated summary for downstream users. |
| Outcome: | The proposed method is more abstract and uses supervised fine-tuning and large-scale instruction tuning to provide more specific and useful summaries for downstream users. |
Early Detection of Sexual Predators in Chats (2021.acl-long)
Copied to clipboard
| Challenge: | Prior work has attempted to identify grooming chats but only after an incidence has already happened in the context of legal prosecution. |
| Approach: | They propose to analyze a running chat and predict grooming attempts as early as possible . they propose to use a new dataset to evaluate the problem from the point of view of prevention . |
| Outcome: | The proposed model is based on existing datasets and their limitations . it can be used to predict grooming attempts as early as possible . |
CAVE: Controllable Authorship Verification Explanations (2025.naacl-long)
Copied to clipboard
| Challenge: | Authorship Verification (AV) is used for tasks such as plagiarism detection, forensic analysis, analysis of the spread of misinformation. |
| Approach: | They propose to train an offline authorship verification model that is accessible and easy to use. |
| Outcome: | The proposed model generates high quality explanations and competitive task accuracy on three difficult AV datasets. |
Program Enhanced Fact Verification with Verbalization and Graph Attention Network (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fact verification based on structured data are challenging and require further study. |
| Approach: | They propose a program-enhanced verbalization and a graph attention network to integrate programs and execution into textual inference models. |
| Outcome: | The proposed framework achieves a new state-of-the-art accuracy on a benchmark dataset . it is compared with existing frameworks on symbolic and informal inference models . |
Multi-granularity Temporal Question Answering over Knowledge Graphs (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on temporal knowledge graphs ignores fact that real-life applications of TKGQA are complex in temporal granularity. |
| Approach: | They propose a large scale dataset for multi-granularity temporal question answering over knowledge graphs . they propose comparing MultiQA over MultiTQ to better reflect real-world challenges . |
| Outcome: | The proposed dataset is among the first of its kind and features multiple temporal granularities. |
Named Entity Recognition to Detect Criminal Texts on the Web (2022.lrec-1)
Copied to clipboard
| Challenge: | Using named-entity extraction techniques, a toolkit that extracts information related to criminal activity from Polish Internet is evaluated on 6240 manually annotated text fragments. |
| Approach: | They propose a toolkit that uses named-entity extraction techniques to identify information related to criminal activity in texts from the Polish Internet. |
| Outcome: | The proposed method is feasible and has potential value for real-life applications in the daily work of border guards. |
WikiBio: a Semantic Resource for the Intersectional Analysis of Biographical Events (2023.acl-long)
Copied to clipboard
Marco Antonio Stranisci, Rossana Damiano, Enrico Mensa, Viviana Patti, Daniele Radicioni, Tommaso Caselli
| Challenge: | Existing corpora and models for biographical event detection are lacking . Detecting biographical events from unstructured data is a useful task to explore and compare bias in representations of individuals. |
| Approach: | They present a corpus annotated for biographical event detection using 20 Wikipedia biographies and 5 existing corpora to train a model. |
| Outcome: | The proposed model detects all mentions of the target-entity in a biography with an F-score of 0.808 and the entity-related events with an 0.859 score. |
Re-Examine Distantly Supervised NER: A New Benchmark and a Simple Approach (2025.coling-main)
Copied to clipboard
| Challenge: | Existing DS-NER approaches rely on large validation sets and test set for tuning inappropriately. |
| Approach: | They propose a method where training data is annotated using domain dictionaries and test data is analyzed by domain experts. |
| Outcome: | The proposed method reduces the need for labor-intensive manual annotations but rely on large human labeled validation set. |
ReCode: Robustness Evaluation of Code Generation Models (2023.acl-long)
Copied to clipboard
Shiqi Wang, Zheng Li, Haifeng Qian, Chenghao Yang, Zijian Wang, Mingyue Shang, Varun Kumar, Samson Tan, Baishakhi Ray, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Dan Roth, Bing Xiang
| Challenge: | Existing work on robustness in text or code tasks has focused on classification, while robustness for code generation tasks is an uncharted area. |
| Approach: | They propose a robustness evaluation benchmark for code generation models that customizes over 30 transformations specifically for code on docstrings, function and variable names, code syntax, and code format. |
| Outcome: | The proposed model performs better on human annotators and on SOTA models with human annnotators. |
Typos Correction Training against Misspellings from Text-to-Text Transformers (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing dense retrieval systems suffer from typoed queries due to mistyping or phonetic typing errors. |
| Approach: | They propose a method that incorporates the spelling correction objective into the DR model and a prompt-based augmentation technique to enhance the alignment of the typoed query and its original query. |
| Outcome: | The proposed model outperforms existing typos-aware training approaches and sophisticated training advanced retrievers. |
EPIR: Capturing Promoting and Inhibiting Relationships between Events (2026.findings-acl)
Copied to clipboard
| Challenge: | promoting and inhibiting relationships capture directional, probabilistic, and context-dependent shifts in event likelihood. |
| Approach: | They propose a framework for estimating promoting and inhibiting relationships from observed event data. |
| Outcome: | The proposed framework outperforms state-of-the-art models on real-world datasets in accuracy. |